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ABSTRACT 

Type la supernova magnitudes conventionally include an additive parameter 
called the extinction coefficient. We find that the extinction coefficients of a pop- 
ular "gold" set are well correlated with the deviation of magnitudes from Hubble 
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>- ■ diagrams. If the effect is due to bias, extinctions have been overestimated, which 

makes supernovas appear more dim. The statistical significance of the extinction- 
acceleration correlation has a random chance probability of less than one in a 
q ■ million. The hypothesis that extinction coefficients should be corrected empir- 

ically provides greatly improved fits to both accelerating and non-accelerating 
models, with the independent feature of eliminating any significant correlation 

Q H - of residuals. 
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1. Introduction 

Type la supernovas are candidates for standard astrophysical candles, from which the 
relation of redshift z and distance can be estimated. In a universe of constant expansion the 
"Hubble plot" made from magnitudes and redshifts should be a straight line. Data is now 
available for a wide range of redshifts up to 1.755 (Schmidt et al. 1998; Garnavich et al. 1998; 
Perlmutter et al. 1998; Riess et al. 1998; Perlmutter et al. 1999; Knop et al. 2003; Tonry et 
al. 2003; Barris et al 2004). The Hubble diagrams derived from supernovae have indicated 
an upward bending curve, interpreted as acceleration of the expansion rate, along with 
even more complicated features of "jerk". It is important to explore other interpretations, 
including possible evolution of supernova or host galaxy characteristics with redshift. Many 
papers have explored non-cosmological explanations (Coil et al. 2000; Leibundgut 2001; 
Sullivan et al. 2003; Riess 2004). Meanwhile, the high redshift host galaxies have significantly 



- 2 - 



different morphologies compared to those at low redshifts (Abraham & van den Bergh 2001; 
Brinchmann et al. 1998; van den Bergh 2001). Dust and related extinction characteristics 
may certainly depend on redshift (Totani & Kobayashi 1999). Furthermore the abundance 
ratios of the progenitor stars may be different at different redshifts (Hoflich et al. 2000). 
Several studies emphasize that evolution effects cannot be ruled out (Falco et al. 1999; 
Aguirre 1999; Farrah et al. 2004; Clements et al. 2004). 

In this paper we find evidence for evolution or bias in the extinction parameters used 
to pre-process the data. If the effect is due to bias, extinctions have been overestimated, 
which makes supernovas appear more dim. Yet just the same phenomenon could occur from 
a real physical effect in which the actual host extinctions are correlated with the deviation 
of magnitudes from model fits. 



1.1. Background 

Traditional Hubble diagrams represent the relation of observed flux JF to the luminosity 
of the source C, 



where d^ is the so-called luminosity distance. The distance modulus /i p = m — M, where m 
and M are the apparent and absolute magnitudes respectively, is 

/i p = 51ogrf L + 25 , (2) 

where the luminosity distance di is in megaparsecs. 

The process of converting observed data into the supernova magnitudes reported ac- 
tually contains an additive parameter, called the extinction coefficient A. Extinction may 
depend on frequency, designated by A B , A R , etc. The units of A are magnitude. In practice 
A shifts the supernova magnitude m deduced from light-curves to a reported magnitude 
("extinction corrected magnitude") m = m — A. Our galaxy contributes extinction, as do 
the additional extinction effects associated with supernova host galaxies, which are more 
model dependent. 
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Fig. I. — The residuals as a function of the host extinction for the concordance model 
VL M = 0.27, tt A = 0.73. 
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Riess et al (2004) discovered 16 Type la supernovas at high redshifts and compiled a 
157 source "gold" data set held to be of the highest reliability. Extinctions are listed in Riess 
et al (2004) for all except 24 sources among this "gold" set. 

2. Analysis 

Riess et al focus on the differences of magnitudes A/i relative to the traditional Hubble 
plot. In Fig. 1 we show the residuals A/i versus the extinction coefficients Ay, for all 
the sources for which extinctions are known. There is a clear correlation. The sense of 
correlation is that points with A/i > 0, lying above the straight line Hubble plot, tend to 
have small or even negative extinction, and points lying below the straight line tend to have 
large extinction. A precedent for examining correlations of residuals is given in Williams et 
al, (2003). 

Residuals depend on the baseline model from which they are measured. Fig.l uses the 
FRW model and "concordance" parameters Qm = 0.27, with = 0.73 under the constraint 
Qk = 0. This is one of the baselines cited by Riess et al (2004). Here Qm is the matter 
density, Q\ the vacuum energy density and Jl^ = 1 — Qm — ^a- The class of FRW models 
predicts the luminosity distance as 

d L = J^^sinn | |Q fe |V2 j* dz [(i + z f{i + n M z) - z(2 + z)Q A ] ~ 1/2 | (3) 

Here sinn denotes sinh for > 0, sin for Qk < and is equal to unity for Qk = 0. Parameters 
are fit by minimizing x 2 , defined by 

2 _ ( /ip — /ip — /ipQ ) 2 

X ~ 2 r (w ' u 

where /j, 1 and /i are the theoretical and observed distance moduli respectively and 5/j, 1 are 
the reported errors. Our notation includes the intercept parameter /i p0 (not always explicit 
in the literature). The Hubble constant Ho and fit parameters such as the zero point are 
not reported in Riess et al (2004), which states that they are irrelevant and arbitrarily set 
for the sample presented here. We verify (Riess et al, 2004) x 2 — 178 for the concordance 
parameters cited above, along with the other x 2 values for several other studies, presented 
below. 
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2.1. Quantification 

We quantify the correlation of extinctions with residuals with the correlation coefficient 
i?(A/i, Ay), also simply R, defined by 

fl( A„, Av) = S,(A ft -AH(-^.--M (5) 

where A/i, are the means and standard deviation of the Afi set, with corresponding 
meaning for a Av , A v . The correlation i?(A/i, A v ) = —0.439 for the concordance parameters 
cited above, excluding the 24 sources for which extinctions are not known. The integrated 
probability (confidence level, P-value) to find correlations equal or larger in a random sample 
is 4.2 x KT 7 . 

To investigate whether the correlation of extinctions with residuals might be a model 
artifact, we decided to fit several other models cited by Riess et al (2004). The results of 
these fits are shown in Table 1. For example, under the best fit model with Qm = 0.31, £7a = 
0.69 = 1- Q M then R(Afi, A v ) = -0.434 with probability P = 5.6 x 10~ 7 . 
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Fig. 2. — Residuals versus A v , including reported uncertainties assigned to the residuals. 
By inspection the region of Ay > 0.3 shows systematic correlation. 



-7- 



From Fig. 1 we see that the correlation is strongest for large values of Ay. For example, 
for the best fit parameters (0 M = 0.31, fl\ = 0.69) we find that excluding the four sources 
with Ay > 0.8 the correlation coefficient goes down to R(Afi, Ay) = —0.28 with P = 
1.5 x 10~ 3 . Retaining the 139 points with A v < 0.5 yields R{Afi,A v ) = -0.18. We do 
not have a particular reason to entertain these cuts except to make the correlation go away. 
At the risk of complicating interpretation, one can try dividing the residuals by the data 
point's uncertainty. This is an uncertain trial because a fundamental issue is the uncertainty 
in the extinction coefficients, which is unavailable from the literature. Fig. 2 shows the 
correlation with error bars assigned to the residuals. 1 The figure shows that most of the 
data with Ay > 0.3 lies below 0, indicating bias. Division by uncertainty only reduces 
R(Afx/a, Ay) — > —0.37 for the gold set, an effect of having introduced noise. 

We next examine whether the correlation seen in the residuals depends on redshift. 
We divide the data as equally as possible in a large redshift sample (z > 0.41, 78 sources) 
and a low redshift sample (z < 0.41, 79 sources). (The cut z ~ 0.46 was identified by 
the Hubble team as a transition region.) For the low redshift sample we find R( A/i, Ay) = 
—0.509, P = 1.2 x 10 -5 , compared to the high redshift sample yielding R(Afi, Ay) = —0.378, 
P = 3.7 x 10~ 3 . Although statistics have been diluted, it is clear that the two samples 
show different behavior, with the correlation being much more significant in the low redshift 
sample. 



We thank an anonymous referee for this suggestion. 
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Model 


x 2 


R 


P 


n M = 0.27, n A = 0.73 


178.2 


-0.439 


4.2 x 10~ 7 


tt M = 0.31, Q A = 0.69 


177.1 


-0.434 


5.6 x 10~ 7 


(best fit with Qm + — 1) 








Q M = 0.45, Q A = 0.95 (best fit) 


175.1 


-0.403 


3.3 x 10~ 6 


Q M = 0.0, Q A = 0.0 (best fit with tt A = 0.0) 


191.7 


-0.392 


6.0 x 10~ 6 


= 1, = 


324.8 


-0.275 


1.49 x KT 3 



Table 1: x 2 values, the correlation statistic R(A/j,,A v ) between residuals and extinction, 
and confidence level (P) to find i?(A/x, Ay) in a random sample. The different cosmological 
models come from Riess et al (2004). 
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Questions then branch along three lines: (1) The assignment of extinctions by present 
schemes may contain hidden bias. (2) There may be a real physical effect at work, and 
(3) Systematic errors might be re-evaluated in order to ameliorate the significance of the 
correlation. 

-k 1: A seldom discussed but established bias exists in the assignment of Ay from the 
fits to light curves. We find it highlighted by the Berkeley group (Perlmutter et al 1999, 
especially the Appendix). The scheme used starts with a conditional probability P(A\A dat ) ) 
where A dat is the extinction from the best fit to the light curve data. A prior probability 
Po{Adat) is assumed, and from Bayes' Theorem the probability of A after seeing the data is 
estimated. The value of A is chosen to "maximize the probability of A" given the combined 
information from the prior and the data. 

The method introduces an extra dependence on the choice of priors. For prior distribu- 
tions centered at small host extinction, the work of Hatano (1998) is cited, based on Monte 
Carlo estimates from host galaxies of random orientation. Freedom is used to formulate a 
one-sided prior distribution with support limited to A > 0. This make a bias in the combi- 
nation of assuming A > for the priors (fluctuations could do otherwise) and the detailed 
way in which A dat is assigned. This bias tends to cause the same signal as dimming or 
acceleration (Perlmutter et al (1999)). As of 1999 the outcomes of this bias were stated to 
be less than 0.13 magnitude. 

Yet one would need an absolute standard to evaluate any bias reliably. Subsequently 
the method itself has evolved (Riess et al. 2004), citing an iterative "training procedure" we 
have not found described in detail. A few points now have Ay < 0. 

There is evidently a further bias in taking data from the peak of the proposed distri- 
bution. It is not the same thing as sampling the proposed distribution randomly. Iteration 
of a procedure taking from the peak tends to drive a Bayesian update procedure towards 
a narrow distribution centered at the peak. In some renditions this may cause systematic 
errors of fluctuations to evolve towards becoming underestimated. 

* 2: It is possible that the extinction correlation is a signal of physical processes of 
evolution with redshift. It is impossible to adequately summarize the literature discussing 
this possibility. Aguirre (1999) made a comparatively early study with a balanced conclusion 
that extinction models might cause some of the effects interpreted as acceleration. Drell, 
Loredo & Wasserman (2000) concentrate on this question, concluding that the methodology 
of using type la supernovas as standard candles cannot discriminate between evolution 
and acceleration. Farrah et al. (2004) (see also Clements et al. 2004) cite a history of 
work scaling optical frequency extinction with the sub-millimeter wavelength observations 
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(Hildebrand 1983; Casey 1991; Bianchi 1999). They report extinction for 17 galaxies with 
z = 0.5 with sub-millimeter wavelengths. While stating consistency with local extinctions 
at the 1.3a level, they add "It does however highlight the need for caution in general in 
using supernovae as probes of the expanding Universe, as our derived mean extinction, 
Ay = 0.5 ± 0.17, implies a rise that is at face value comparable to the dimming ascribed to 
dark energy. Therefore, our result emphasizes the need to accurately monitor the extinction 
towards distant supernovae if they are to be used in measuring the cosmo logical parameters." 
The trend of Farrah's observation is same as the correlation seen in the supernova data, and 
remarkably, the corrections we obtain empirically in various fits (below) almost all amount 
to 0.5 magnitude or less. The fact that low redshift objects show higher correlation implies 
that there is a higher tendency to overestimate extinctions of these sources in comparison 
to the sources at higher redshifts. Since the estimated extinctions show no correlation with 
redshift, this suggests that the true low redshift extinctions, on the average, may be smaller in 
comparison to the extinctions of high redshift sources. Nevertheless the question of evolution 
of the sources remains open and will not be resolved here. 

* 3: Perhaps the means of assigning extinction coefficients are reasonable on average, 
but statistical fluctuations have given a false signal. Then the error bars on the extinction 
coefficients come to be re-examined. Inasmuch as this is coupled to the entire chain of data 
reduction, it is beyond the scope of this paper. 



2.2. Empirically Corrected Extinctions 

Without engaging in physical hypotheses of extinction, it is reasonable to test whether 
a different extinction model can give a satisfactory fit to the data. We studied a corrected 
value Ay (S) depending on the parameter 5 by the simple rule 

Ay(5) = (l+5)Ay . (6) 

We then determine 5 by the best fit to the cosmological model. The best fit 5-values and 
the corresponding x 2 values for different models are given in Table 2. Parameter 8 produces 
a huge effect of more than 23 units of x 2 ■ 

There are many ways to compare the new and old fits. As a rule, the model with x 2 per 
degree of freedom (dof, the number of data points minus the number of parameters) closest 
to unity is favored. Since the new fits decrease \ 2 D Y 20-some units with one additional 
parameter, the significance of revising the extinction values is unlikely to be fortuitous. For 
example the model with Vl M = 0.27 and Ha = 0.73 gives x 2 /dof = 1.14 and 1.01 without 
correction (5 = 0) and with correction (5 = —0.42). As a broad rule in comparing data sets, 
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the difference Ax 2 should be distributed by xt, where v — 1 is the number of parameters 
added. The naive p-value or confidence level to find Ax 2 = 23 in x\ is 1-6 xlCT 6 . Thus 
introducing 5 would be well-justified simply to improve the poor fit of x 2 ~ 178 without 
ever seeing the extinction correlation with residuals. Values of 5 for all models are found 
to be negative, suggesting that the host extinction values given in Riess et al (2004) are 
overestimates. 

It is interesting and significant that the new residuals, computed relative to the revised 
fits, show negligible correlation with host extinction. This is seen in Fig. 3, which shows the 
R values on the same plot as \ 2 /dof. The fact that R vanishes when S meets the best-fit 
value is significant. It is far from trivial, as R concerns an independent set of numbers, the 
Ay values, not directly used in calculating x 2 ■ 

Figure 4 shows the residuals versus corrected host extinction after including the correc- 
tion term. The reduction in correlation R comes with an increased scatter in Ay (S) at large 
Ay (5), which is not unexpected. 
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Model 


5 


x 2 


R 


P 


tt M = 0.27, Q A = 0.73 


-0.42 


156.0 


-0.12 


0.15 


tt M = 0.32, tt A = 0.68 


-0.43 


154.5 


-0.10 


0.23 


(best fit with VLm + VL A = \) 










tt M = 0.35, tt A = 0.75 (best fit) 


-0.42 


154.4 


-0.11 


0.22 


Q M = 0.0, Q A = 0.0 (best fit with Q A = 0.0) 


-0.49 


162.5 


-0.11 


0.20 


n M = i, = o 


-0.49 


294.6 


0.04 


0.68 



Table 2: The x 2 values for some cosmo logical models including a correction term in the 
distance modulus Ay (5) = (1 + S)A V (Eq. 6) due to possible bias in the host extinction. 
Also shown are the correlation statistic R(Afi, A v ) between residuals and extinction, and 
confidence level (P) to find R in a random sample. 
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Fig. 3. — Best fit values of x 2 /dof versus parameter 5 (upper curves), &m = 0.27 (solid, green on- 
line), 0.5 (dashed, red online), 1 (dotted, blue online) along with extinction correlation R(A/i, Ay) 
(lower curves). It is significant that R(A/i, Ay) crosses zero just in the vicinity of the best fit 5 
parameter. 
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It is also interesting to ask whether host extinction might have some dependence on the 
luminosity distance d^. It is hard to imagine no evolution at all, and we explored a linear 
ansatz. The linear model is 

A v (5,d L ) = (l + 5)A v + 5 1 d L . (7) 

We add that when a model of evolution is introduced, the cosmological interpretation might 
be disturbed, so that the outcomes must be taken in context. More cannot be anticipated 
because the fits themselves will choose 5±. Fit parameters and x 2 values are given in Table 
3. 
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Fig. 4. — Magnitude residuals A/x versus host extinction after including a correction term 
-Ay (5) = (1 + 5)A V (Eq. 6) in the distance modulus. Parameters Vt M = 0.27, f2 A = 0.73 = 
1 - n M , 5 = -0.42, as in Table 2. 
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2.2.1. Is Acceleration Supported? 

Accelerating models show no need for the Si term. Assuming acceleration, the fits (Table 
3) show that reducing extinction values by about 40% explains the data better, and removes 
an alarming correlation. On the other hand the matter-dominated model {Qm — 1> — 0) 
shows interesting sensitivity to Si. In Fig. 5 we compare the sensitivity of different fits to 
parameter Q M - With Si — constrained, the effects of 5 are rather orthogonal to those of 
Qm, so that the region Qm ~ 0.3 is favored whether or not there is a significant correlation 
R. Yet varying Si greatly broadens acceptable values of Qm, while maintaining the R — > 
effect of S. The significance depends on one's hypothesis: if one chooses Qm — 1 a-priori, 
parameter Si is traded for parameter Qm- The overall probability of either hypothesis is 
only in part determined by the p-value of the data given the distribution: the rest depends 
on one's prior beliefs in evolution, which we will not pursue. It is fair to say that the revised 
fits give more leeway to matter-dominated models on statistical grounds. 

In all cases fits are driven to Ay — > Ay (5 ~ —0.4) ~ 0.6Ay, either simply to improve 
X 2 /dof, or to remove the correlation with residuals. 

To conclude, analysis using reported extinction coefficients is well known to produce 
good fits to acceleration of the expansion rate. However the extinctions show correlation 
with residuals with random chance probability using two independent tests, the extinction 
correlation and \ 2 values, both below the level of 10~ 6 . The hypothesis that extinction 
coefficients should be corrected empirically provides substantially improved fits to the data, 
while also eliminating significant correlation of residuals. A model of linear evolution yields 
interesting effects of high statistical significance correlated with redshift. The studies indicate 
either bias in host extinction assignments or evolution of the source galaxies. The significance 
of acceleration itself cannot be resolved on the basis of these studies, but might be revised, 
depending on one's priors. We suggest that observers report uncertainties in their assignment 
of extinction parameters, both in the future and for the existing data sets. 
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Model 


5 


Si 


x 2 


R 


P 


n M = 0.27, n A = 0.73 


-0.42 


-0.037 


154.6 


-0.11 


0.18 


tt M = 0.31, Q A = 0.69 


-0.42 


-0.007 


154.5 


-0.11 


0.20 


(best fit with Qm + ^a — 1) 












Q M = 0.68, Q A = 0.82 (best fit) 


-0.42 


0.16 


154.0 


-0.079 


0.36 


Q M = 0.0, fi A = 0.0 


-0.48 


0.005 


162.4 


-0.11 


0.19 


(best fit with tt A = 0.0) 












= 1, = 


-0.51 


0.47 


166.9 


-0.03 


0.73 



Table 3: The x 2 values for some cosmological models, including a correction term Ay (5, di) = 
(1 + S)Ay + SicIl (Eq. 7) in the distance modulus due to possible bias. 
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Fig. 5. — The x 2 values versus Qm parameter in various models: with uncorrected extinctions 
(5 = 0, solid, red online), best fit Ay (8) = (1 + S)Ay (short dashed, red online), best fit 
Ay(dL) = A v + 5idi (long dashed, blue online), and best fit Ay (5, d L ) = (1 + 5) Ay + 8id^ 
(dotted curve, blue online). The models with 8\ ^ are less sensitive to the value of Qm- 
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